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1. Introduction 



Met ast ability is a generic feature of many nonlinear systems, and the 
problem of the lifetime of metastable states involves fundamental aspects of 
nonequilibrium statistical mechanics. Nonequilibrium systems are usually 
open systems which strongly interact with environment through exchang- 
ing materials and energy, which can be modelled as noise. The investigation 
of noise-induced phenomena in far from equilibrium systems is one of the 
approaches used to understand the behaviour of physical and biological com- 
plex systems. Specifically the relaxation in many natural complex systems 
proceeds through metastable states and this transient behaviour is observed 
in condensed matter physics and in different other fields, such as cosmol- 
ogy, chemical kinetics, biology and high energy physics [I]-[9]. In spite of 
such ubiquity, the microscopic understanding of metastability still raises 
fundamental questions, such as those related to the fluctuation-dissipation 
theorem in transient dynamics [lOJ . 




Recently, the investigation of the thermal acivated escape in systems 
with fluctuating metastable states has led to the discovery of resonancelike 
phenomena, characterized by a nonmonotonic behavior of the lifetime of 
the metastable state as a function of the noise intensity or the driving fre- 
quency. Among these we recall two of them, namely the resonant activation 
(RA) phenomenon [Il]-[2T], whose signature is a minimum of the lifetime 
of the metastable state as a function of a driving frequency, and the noise 
enhanced stability (NES) [3], [IT]- [27]. This resonancelike effect, which con- 
tradicts the monotonic behavior predicted by the Kramers formula [28\ I29|. 
shows that the noise can modify the stability of the system by enhancing the 
lifetime of the metastable state with respect to the deterministic decay time. 
Specifically when a Brownian particle is moving in a potential profile with 
a fluctuating metastable state, the NES effect is always obtained, regard- 
less of the unstable initial position of the particle. Two different dynamical 
regimes occur. These are characterized by: (i) a monotonic behavior with 
a divergence of the lifetime of the metastable state when the noise intensity 
tends to zero, for a given range of unstable initial conditions (see for detail 
Ref. [M])) which means that the Brownian particle will be trapped into the 
metastable state in the limit of very small noise intensities; (ii) a nonmono- 
tonic behavior of the lifetime of the metastable state as a function of noise 
intensity. The noise enhanced stability effect implies that, under the ac- 
tion of additive noise, a system remains in the metastable state for a longer 
time than in the deterministic case, and the escape time has a maximum 
as a function of noise intensity. We can lengthen or shorten the mean life- 
time of the metastable state of our physical system, by acting on the white 
noise intensity. The noise-induced stabilization, the noise induced slowing 
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down in a periodical potential, the noise induced order in one-dimensional 
map of the Belousov-Zhabotinsky reaction, and the transient properties of 
a bistable kinetic system driven by two correlated noises, are akin to the 
NES phenomenon [22j. 

In this paper we will review these two noise-induced effects in mod- 
els of interdisciplinary physics, ranging from condensed matter physics to 
biophysics. Specifically in the first section, after shortly reviewing the theo- 
retical results obtained with a model based on a piece- wise linear fluctuating 
potential with a metastable state, we focus on the noise-induced effects RA 
and NES. In the next sections, we show how the enhancement of the life- 
time of metastable states due to the noise and the suppression of noise, 
through resonant activation phenomenon, occur in the following interdisci- 
plinary physics models: (i) dynamics of an overdamped Josephson junction; 
(ii) transient regime of the noisy FitzHugh-Nagumo model; (iii) population 
dynamics. 

2. The model 

As an archetypal model for systems with a metastable state and strongly 
coupled with the noisy environment, we consider the one-dimensional over- 
damped Brownian motion in a fluctuating potential profile 

dx d[U{x)+V{x)ii{t)] 

^ = + ^('^' 

where x{t) is the displacement of the Brownian particle and ^(t) is the 
white Gaussian noise with the usual statistical properties: < ^(t) >= 0, 
< ^(i)^(t') >= 2Z) 6{t—t'). The variable rj (t) is the Markovian dichotomous 
noise, which takes the values ±1 with the mean flipping rate v. The potential 
profile U (x) + V (x) corresponds to a metastable state, and U (x) — V (x) 
corresponds to an unstable one, with a reflecting boundary at x — > — oo 
and an absorbing boundary at x — > -|-oo (see Fig. [TJ. Starting from the 
well-known expression for the probability density of the process x{t) 

P{x,t) = {6{x-xm (2) 
and using the auxiliary function Q {x,t) 

Q{x,t) = {ri{t)6{x-xm, (3) 

and the Eq. ([1]), we obtain the set of differential equations 
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Fig. 1. Switching potential with metastable state. 

£!5|^ = _.„0 + iL[c'(.)<5 + ,.,.)P] + og. (4) 

The average lifetime of Brownian particles in the interval (Li, L2), with the 
initial conditions P (x, 0) = 5 {x — xq) and Q (x, 0) = ±6 {x — xq), is 

roo /■L2 rL2 

T (xq) = / dt P {x,t\xQ,0) dx = / Y {x,X(),0) dx , (5) 

JO JLi Jli 

where Y {x,xq,s) is the Laplace transform of the conditional probability 
density P {x,t\xo,0). After Laplace transforming Eqs. with above- 
mentioned initial conditions and using the method proposed in Refs. \25\ 
[261 [30], we can express the lifetime t{xq) as 

T (xo) = / Zi (x,xo) dx, (6) 

where Zi(x,xo) is the linear coefficient of the expansion of the function 
sy(x,xo,s) in a power series in s. By Laplace transforming the auxiliary 
function Q{x,t) in R{x,xo, s), and expanding the function sR{x,xo, s) in 
similar power series, we obtain the following closed set of integro-differential 
equations for the functions Zi (x,xo) and -Ri (x,xo) [IZ| 



DZ[ + U' (x) Zi + V' (x) Ri = -e{x- xo) , 

DR[ + U'Ri + V'Zi = 2u r Ridy ^ d {x - xq) , (7) 

J —00 

where 0{x — xq) is the Heaviside step function, and Ri {x,xq) is the linear 
coefficient of the expansion of the function sR{x, xq, s). We put equal to 
zero the probability flow at the reflecting boundary x = — 00. These general 
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equations ([6]) and ([7]) allow to calculate the average lifetime for potential 
profiles with metastable states. We may consider two mean lifetimes r_|_ (xq) 
and r_ (xq), depending on the initial configuration of the randomly switch- 
ing potential profile: U {x) + V {x) or U {x) — V (x). The average lifetime 
([6]) is equal to t+ (xq), when we take the sign "— " in the second equation 
of system ([7]), and vice versa for r_ (xq). 

We consider now the following piece-wise linear potential profile 



{-|-oo, X < 

0, < X < L (8) 

k {L — x) , X > L 

and V (x) = ax {x > 0, < a < k). Here we consider the interval Li = 
0, L2 = b, with b > L. After solving the differential equations d?]) with 
the potential profile ([8]), and by choosing the initial position of Brownian 
particles at x = 0, we get the exact mean lifetime 

r- {x,n = 0) = ^ + ^ + ^ f{D,r,u), (9) 

where T = \/a'^ + 2uD. Here f{D,T,i'), which is also a function of the 
potential parameters a, b, L, k, has a complicated expression in terms of 
parameters -D,r and u [T7]. It is worthwhile to note that Eq. ^ was 
derived without any assumptions on the white noise intensity D and on the 
mean rate of flippings 1^ of the potential. 

To look for the NES effect, which is observable at very small noise in- 
tensity [21 [23] , we derive the average life time in the limit D — > 

r_ (xi„ = 0) = To + ^ giq, u;,s)+o (D) , (10) 

where to = vL/k, q = a/k and s = 2uj {b/L — 1) / (1 — q'^) are dimensionless 
parameters. Here 



, , 3g2+4g-5 ^ 3q'^ + q - 3 2^^ 

g{q,uj,s) = —- ^ + 2u— 2" 

2(1 — q'') q{l — q-^) q^^ 

+ 9') , -sx q{l-q^-2q^) 



-se 



(l + g)(l-g2) 



+ (1 



and 



2L vL^ b-L 



To = — + 



+ 



a 



2v 



' 2(1 - g2) 
:i - e-^) 



(12) 
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Fig. 2. Semilogarithmic plot of the normalized mean lifetime t_ (xm = 0)/to vs 
the white noise intensity D for three values of the dimensionless mean flipping rate 
Lo = uL/k: 0.03 (curve 1), 0.01 (curve 2), 0.005 (curve 3). Parameters are L = 1, 
/c = 1, 5 = 2, and a = 0.995. 

is the mean lifetime in the absence of white Gaussian noise {D = 0). The 
condition to observe the NES effect can be expressed by the inequahty 



The main conclusions from the analysis of the inequality (|13p are: (i) the 
NES effect occurs at g ~ 1, i.e. at very small steepness k — a = k{l — q) 
of the reverse potential barrier for the metastable state: for this potential 
profile, a small noise intensity can return particles into potential well, after 
they crossed the point L; (ii) for a fixed mean flipping rate, the NES effect 
increases when q ^ 1, and (iii) for fixed parameter q the effect increases 
when u; — > 0, because Brownian particles have enough time to move back 
into potential well. 

Under very large noise intensity D, the Brownian particles "do not see''' 
the fine structure of potential profile and move as in the fixed potential 
U{x) = —kx. Therefore the average life time decreases with noise intensity, 
tending to the value b/k as follows from Eq. ([9]) in the limit D ^ oo. In 
Fig. [2] we show the plots of the normalized mean lifetime r_ (xj„ = 0) /tq, 
Eq. ([2D, as a function of the noise intensity D for three values of the 
dimensionless mean flipping rate uj = uL/k: 0.03, 0.01, 0.005. The values 
of the parameters of the potential profile are: L = A; = 1, o = 0.995, 6 = 2. 
The maximum value of the average lifetime and the range of noise intensity 
values, where NES effect occurs, increases when to decreases. By using 
exact Eq. ^ we have also investigated the behaviour of the mean lifetime 
= 0) as a function of switchings mean rate u of the potential profile. 
In Fig. [3]we plot this behaviour for six values of the noise intensity, namely: 
D = 0.08,0.1,0.13,0.16,0.2,0.25. At very slow flippings {v 0) we obtain 



g{q,u;,s) > 0. 



(13) 
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Fig. 3. Semilogarithmic plot of the mean lifetime t_ (0) vs the dimensionless mean 
flipping rate u = vL/k for seven noise intensity values. Specifically from top to 
bottom on the right side of the figure: D = 0.08, 0.1, 0.13, 0.16, 0.2, 0.25. The other 
parameters are the same as in Fig. [2] 




d(i- e-'^^/^'l 



-(.^0)(^m = 0) ~Trf ^^2(1^^) > (14) 

i.e. the average lifetime of the fixed unstable potential U (x) — ax. Here 
Td = L/a + (6 — L)/{k + a) is the deterministic time at zero frequency 
(z^ = 0). While for very fast switchings {u oo) we obtain 



b L2 

k ^ 2D' 



-(!.^oo)(a;m = 0) =^ - + — , (15) 



i.e. the mean lifetime for average potential U (x). All limiting values of 
r_(xm = 0), expressed by Eqs. and p^ . are shown in Fig. [3l At in- 
termediate rates the average escape time from the metastable state exhibits 
a minimum at co = 0.1, which is the signature of the resonant activation 
(RA) phenomenon |llj-|15]. If the potential fluctuations are very slow, the 
average escape time is equal to the average of the crossing times over upper 
and lower configurations of the barrier, and the slowest process determines 
the value of the average escape time [llj. In the limit of very fast fluctu- 
ations, the Brownian particle "sees" the average barrier and the average 
escape time is equal to the crossing time over the average barrier. In the 
intermediate regime, the crossing is strongly correlated with the potential 
fluctuations and the average escape time exhibits a minimum at a resonant 
fluctuation rate. Specifically, for D ^ 1 and the parameter values of the 
potential (a = 0.995, L = A; = 1, 6 = 2), we obtain from Eqs. ([HD and (L5\i : 
r_(j,^o)(a:m = 0) ~ 1.5 - D/2, and T_(^^_oo){xin = 0) ~ 2 + 1/(21)), that is 

T-iiy~*0){xin = 0) < T_(^^oo)(a;m = 0) (16) 
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which is consistent with the physical picture for which we have at zero 
frequency of switchings the unstable initial configuration of the potential 
(see Fig. [TJ, and at very fast switchings — > oo) the average configuration 
of the potential, which in our case has not barrier. For D ^ 1, because 

lim d(i- e""^/^) = aL , (17) 



D^oo 



we have r_(^^o)(a^m = 0) = b/{k + a) ~ 1, and r_(^^oo)(a^m = 0) = 2. So, 
for the noise intensity values used in our calculations shown in Fig. [3l ranging 
from D = 0.08 to -D = 0.25, the limiting values for the average lifetime are: 
r_(^^o)(a;m = 0) ~ (1.38-^1.46), and r_(,,^oo)(a^m = 0) ~ (4^8), which are 
consistent with the limiting values shown in Fig. [3l and evaluated directly 
from exact expression ([9|). 

Moreover, in Fig. [3] a new resonance-like behaviour, is observed. The 
mean lifetime of the metastable state T-{xin = 0) exhibits a maximum, 
between the slow limit of potential fluctuations (static limit) and the RA 
minimum, as a function of the mean fluctuation rate of the potential, . This 
maximum occurs for a value of the barrier fluctuation rate on the order of 
the inverse of the time Tup{D) required to escape from the metastable fixed 
configuration 

h-L L Die-^l'^-l 

1 :^ 

k — a a {1 — q) 

Specifically we observe that this maximum increases with decreasing noise 
intensity D and at the same time the position of the maximum is shifted 
towards lower values of the dimensionless mean flipping rate to. In fact 
from Eq. (|18p we have that the average time required to escape from the 
metastable fixed configuration r^p increases, consequently the corresponding 
rate of the barrier fluctuations uJmax — ^/Tup{D) decreases, as shown in 
Fig. [31 We can also estimate the value of the maximum (j-^^^{xin = 0)) 
and its position {oJmax)-, by expanding Eqs. p ^ - p^ in a power series up 
to the second order in u). Using the same parameter values of the potential 
we have: oj = v, s = 2a;/(l — q^), se~'^ ^ s — s^, and 1 — e~* s — ^. We 
obtain finally: 



up{D) = - + ^^__^. (18) 



r_ {xin = 0) f« 2.5 + (98.7)Z) + w[51 + (347.4)L»] - (2 x lid^)u'^D . (19) 

For D = 0.1 we have: t_^^^ ~ 12.3 and Wmax ~ 2 x 10~^, which are an 
estimate of the coordinates of the maximum of the corresponding curve 
in Fig. [3l From small noise intensity D ^ 0, from Eq. (jlOp . we obtain: 

'^-max ~ ^-^^^ 1- 0{D). The maximum of the average lifetime t_^^^, 

therefore, increases when the noise intensity decreases as shown in Fig. [3l 
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This suggests that, the enhancement of stabihty of metastable state is 
strongly correlated with the potential fluctuations, when the Brownian par- 
ticle "sees" the barrier of the metastable state [3l[T71[23]. When the average 
time to cross the barrier, that is the average lifetime of the metastable state, 
is approximately equal to the correlation time of the fluctuations of the po- 
tential barrier, a resonance-like phenomenon occurs. In other words, this 
new effect can be considered as a NES effect in the frequency domain. It is 
worthwhile to note that the new nonmonotonic behaviour shown in Fig. [3] 
is in good agreement with experimental results observed in a periodically 
driven Josephson junction (J J) [20j. In this very recent paper the authors 
experimentally observe the coexistence of RA and NES phenomena. Specif- 
ically they found (see Fig. 3 of the paper [20j) that the maximum increases 
with decreasing bias current and at the same time the position of the max- 
imum is shifted towards lower values of w. A decrease of the bias current 
causes (see next section on transient dynamics of a JJ) a decrease of the 
slope of the potential profile, which corresponds to a decreasing parame- 
ter k in our model (Eq. dS])). Therefore, the average lifetime maximum 
r_^^^ increases and as a consequence the time required to escape from the 
metastable fixed configuration Tup{D) increases too. Consequently, the cor- 
responding rate of the barrier fluctuations tOmax — ^/Tup{D) decreases, as 
observed experimentally. Of course a more detailed analysis of the JJ sys- 
tem as a function of the temperature, that is the noise intensity, should add 
more interesting results. 

Finally we note that in the frequency range uj £ (10~^ 10~^), for fixed 
values of the mean flipping rate, an overlap occurs in the curves for different 
values of the noise intensity. A nonmonotonic behavior of r_(xj„ = 0) as 
a function of the noise intensity is observed, as we expect in the transient 
dynamics of metastable states [31 El [53] . 

3. Transient dynamics in a Josephson junction 

The investigation of thermal fluctuations and nonlinear properties of 
Josephson junctions (JJs) is very important owing to their broad applica- 
tions in logic devices. Superconducting devices, in fact, are natural qubit 
candidates for quantum computing because they exhibit robust, macro- 
scopic quantum behavior [31] . Recently, a lot of attention was devoted 
to Josephson logic devices with high damping because of their high-speed 
switching [18[ I32|. The rapid single flux quantum logic (RSFQ), for exam- 
ple, is a superconductive digital technique in which the data are represented 
by the presence or absence of a flux quantum $o = h/2e, in a cell which 
comprises Josephson junctions. The short voltage pulse corresponds to a 
single flux quantum moving across a Josephson junction, that is a 2ti phase 
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flip. This short pulse is the unit of information. However the operating 
temperatures of the high-Tc superconductors lead to higher noise levels 
by increasing the probability of thermally-induced switching errors. More- 
over during the propagation within the Josephson transmission line fluxon 
accumulates a time jitter. These noise-induced errors are one of the main 
constraints to obtain higher clock frequencies in RSFQ microprocessors [32] . 

In this section, after a short introduction with the basic formulas of 
the Josephson devices, the model used to study the dynamics of a short 
overdapmed Josephsonn junction is described. The interplay of the noise- 
induced phenomena RA and NES on the temporal characteristics of the 
Josephson devices is discussed. The role played by these noise-induced ef- 
fects, in the accumulation of timing errors in RSFQ logic devices, is ana- 
lyzed. 

The Josephson tunneling junction is made up of two superconductors, 
separated from each other by a thin layer of oxide. Starting from Schrodinger 
equation and the two-state approximation model [33], it is straightforward 
to obtain the Josephson equation 

d^{t) _ 2eV{t) 
dt ~ h ' ^^^> 

where (p is the phase difference between the wave function for the left and 
right superconductors, V{t) is the potential difference across the junction, 
e is the electron charge, and h = h/27T is the Planck's constant. A small 
junction can be modelled by a resistance R in parallel with a capacitance 
C, across which is connected a bias generator and a phase-dependent cur- 
rent generator, Isinip, representing the Josephson supercurrent due to the 
Cooper pairs tunnelling through the junction. Since the junction oper- 
ates at a temperature above absolute zero, there will be a white Gaussian 
noise current superimposed on the bias current. Therefore the dynamics 
of a short overdamped JJ, widely used in logic elements with high-speed 
switching and corresponding to a negligible capacitance C, is obtained from 
Eq. (j20p and from the current continuity equation of the equivalent circuit 
of the Josephson junction. The resulting equation is the following Langevin 
equation 

-iM*) du{ip) . 

—TT- = 1 ^F{t), (21) 

at dip 

valid for (3 <^ 1, with /? = 2eIcR'^C/h the McCamber-Stewart parameter. 

If 

Ic the critical current, and ipit) = -p , with Ip the random component of 

-'c 

the current. Here 
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n((y9, t) = 1 — cosip — i{t)ip, with i{t) = io + f{t), 



(22) 



is the dimensionless potential profile (see Fig. [4]), 99 is the difference in the 
phases of the order parameter on opposite sides of the junction, f{t) = 

Asm{ujt) is the driving signal, i ^ 



Ir 



UOr, 



n 



is the characteristic 



frequency of the J J, and Rn is the normal state resistance (see Ref. [33]). 

When only thermal fluctuations are taken into account [33], the random 

current may be represented by the white Gaussian noise: {ipit)) = 0, 

/ ^• / ^^ 2L» , , ^ 2ekT It 
{iF{t)iF{t + T))= J(r), where D 



file. 



Ir 



is the dimensionless 



intensity of fluctuations, T is the temperature and k is the Boltzmann con- 
stant. The equation of motion Eq. (j2ip describes the overdamped motion 



u(ip) 

10^ 



-5^ 



-10 -6-22 6 10 

f 

Fig. 4. The potential profile u{ip) = 1 — cos — for values of the current, namely 
i = 0.5 (solid line) and i — 1.2 (dashed line). 



of a Brownian particle moving in a washboard potential (see Fig. Hj). A 
junction initially trapped in a zero- voltage state, with the particle localized 
in one of the potential wells, can escape out of the potential well by ther- 
mal fluctuations. The phase difference if fluctuates around the equilibrium 
positions, minima of the potential u{(p), and randomly performs jumps of 
27r across the potential barrier towards a neighbor potential minimum. The 
resulting time phase variation produces a nonzero voltage across the junc- 
tion with marked spikes. For a bias current less than the critical current 
Ic, these metastable states correspond to "superconductive" states of the 
JJ. The mean time between two sequential jumps is the life time of the 
superconductive metastable state [25]. For an external current greater than 
Ic, the JJ junction switches from the superconductive state to the resistive 
one and the phase difference slides down in the potential profile, which now 
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has not equilibrium steady states. A Josephson voltage output will be gen- 
erated in a later time. Such a time is the switching time, which is a random 
quantity. In the presence of thermal noise a Josephson voltage appears even 
if the current is less than the critical one {i < 1), therefore we can identify 
the lifetime of the metastable states with the mean switching time \18\ I25j. 
For the description of our system, i. e. a single overdamped JJ with noise, 
we will use the Fokker-Planck equation for the probability density W{ip,t), 
which corresponds to the Langevin equation (j2ip 



The initial and boundary conditions of the probability density and of the 
probability current for the potential profile ()22p are as follows: W{ip, 0) = 
6{if — ifo), W{+oo,t) = 0, G{—oo,t) = 0. Let, initially, the JJ is biased 
by the current smaller than the critical one, that is io < 1, and the junc- 
tion is in the superconductive state. The current pulse f{t), such that 
iit) = ^0 + fit) > 1) switches the junction into the resistive state. An 
output voltage pulse will appear after a random switching time. We will 
calculate the mean value and the standard deviation of this quantity for 
two different periodic driving signals: (i) a dichotomous signal, and (ii) a 
sinusoidal one. We will consider different values of the bias current io and 
of signal amplitude A. Depending on the values of io and A, as well as 
values of signal frequency and noise intensity, two noise-induced effects may 
be observed, namely the resonant activation (RA) and the noise enhanced 
stability (NES). Specifically the RA effect was theoretically predicted in 
Ref. [TT] and experimentally observed in a tunnel diode [13j and in un- 
derdamped Josephson tunnel junctions [TUl and the NES effect was 
theoretically predicted in [22\ [23} [25] and experimentally observed in a tun- 
nel diode [3J and in an underdamped Josephson junction i20j. The RA and 
NES effects, however, have different role on the behavior of the temporal 
characteristics of the Josephson junction. They occur because of the pres- 
ence of metastable states, in the periodic potential profile of the Josephson 
tunnel junction, and the thermal noise. Specifically, the RA phenomenon 
minimizes the switching time and therefore also the timing errors in RSFQ 
logic devices, while the NES phenomenon increases the mean switching time 
producing a negative effect [18j. 



Now we investigate the following temporal characteristics: the mean 
switching time (MST) and its standard deviation (SD) of the Josephson 




(23) 



3.1. Temporal characteristics 
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junction described by Eq. (I2ip . These quantities may be introduced as char- 
acteristic scales of the evolution of the probability P{t) = / W {ip,t)dip, to 

find the phase within one period of the potential profile of Eq. ()22p . We 
choose therefore = tt, ifi = —it and we put the initial distribution on the 
bottom of a potential well: ifo = arcsin(zo)- A widely used definition of such 
characteristic time scales is the integral relaxation time (see the paper by 
Malakhov and Pankratov in Ref [l2]). Let us summarize shortly the results 
obtained in the case of dichotomous driving, f{t) = ^sign(sin(u;t)). Both 
MST and its SD do not depend on the driving frequency below a certain 
cut-off frequency (approximately 0.2iOc), above which the characteristics de- 
grade. In the frequency range from to 0.2iJc, therefore, we can describe the 
effect of dichotomous driving by time characteristics in a constant potential. 
The exact analytical expression of the first two moments of the switching 
time are |18j 



Tc(V'o) 



DuJr. 



^2 



f2 



e D dipdx + D dip J e D dip 

•4>\ •4>2 



(24) 



and 



T2c{p>o) = T^{p>o) - e D H{x)dx - H{ipo) e d dx, (25) 

JlpQ Jlfil 
OO 1^2 OO 

where H{x) = J e"(")/^ / e-"(f)/-^ / e^'^''^/'^ dzdydv. The asymptotic 

X V y 

expressions of the MST and its standard deviation (SD), obtained in the 
small noise limit {D <^ 1), agree very well with computer simulations up to 
D = 0.05 |18j . Therefore, not only low temperature devices {D < 0.001), 
but also high temperature devices may be described by these expressions. If 
the noise intensity is rather large, the phenomenon of NES may be observed 
in our system: the MST increases with the noise intensity. Here we note 
that it is very important to consider this effect in the design of large arrays 
of RSFQ elements, operating at high frequencies. To neglect this noise- 
induced effect in such nonlinear devices it may lead to malfunctions due to 
the accumulation of errors. 

Now let us consider the case of sinusoidal driving. The corresponding 
time characteristics may be derived using the modified adiabatic approxi- 
mation [m [18] 

P{^o,t)=exp\- f ^ dt'\, (26) 
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with Tc{(po,t') given by Eq. ()24|) . after inserting in this equation the time 
dependent potential profile u{ip,t) of Eq. (p2]) . Using the relation r = 
J^^°° P{(po,t)dt we calculate the MST. We focus now on the current value 
i = 1.5, because i = 1.2 is too small for high frequency applications. In 
Fig. [5] the MST and its SD as a function of the driving frequency, for three 
values of the noise intensity (D = 0.02, 0.05, 0.5), for a bias current iq = 0.5, 
and A = 1 are shown. We note that, because ipo = arcsin(io) depends on 
io, the switching time is larger for smaller iq. However, great bias current 
values io, in the absence of driving, give rise to the reduction of the mean life 
time of superconductive state, i.e. to increasing storage errors (Eq. ([23])). 
Therefore, there must be an optimal value of bias current io, giving min- 
imal switching time and acceptably small storage errors. We observe the 
phenomenon of resonant activation: MST has a minimum as a function of 
driving frequency. 



T(w),cr(w) 




Fig. 5. The MST and its SD vs frequency for f{t) — As'm{ujt) (computer simula- 
tions) for three values of the noise intensity. Namely: Long-dashed line - D — 0.02, 
short-dashed line - D = 0.05, solid line - D — 0.5. The value of the bias current is 
io = 0.5, and the total current is i = 1.5. 

The approximation (I26p works rather well below 0.1 ojc, that is enough 
for practical applications (see the inset of Fig. 3 in ref. [H] ) . It is interesting 
to see that near the minimum the MST has a very weak dependence on 
the noise intensity (as it is clearly shown in the r behavior of Fig. [5] for 
three values of the noise intensity), i. e. in this signal frequency range 
the noise is effectively suppressed. This noise suppression is due to the 
resonant activation phenomenon: a minimum appears in the MST and SD, 
when the escape process is strongly correlated with the potential profile 
oscillations. A noise suppression effect, but due to the noise, is reported 
in Ref. [3l]. We observe also the NES phenomenon. There is a frequency 
range in Fig. [5l around (0.2 0.48)wc for io = 0-5, where the switching 
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Fig. 6. The MST vs noise intensity for f{t) = Asin(a;t) and for three values of 
the driving frequency. Namely: lo = 0.1 (long-dashed line), lo = 0.3 (short-dashed 
line), u} = 0.4 (solid line). Inset: The standard deviation (SD) vs noise intensity 
for the same values of driving frequency lo. 



time increases with the noise intensity. To see in more detail this effect we 
report in Fig.[6]the MST t{D) and its SD (t{D) vs the noise intensity D, for 
three fixed values of the driving frequency, namely: oj = 0.1,0.3,0.4. Both 
quantities have nonmonotonic behaviour and the great values of (t{D) near 
the maximum of t{D) confirm that the only information on the MST is not 
sufficient to fully unravel the statistical properties of the NES effect [21]. A 
detailed analysis of the PDF of the lifetime during the transient dynamics is 
required. This is subject of a forthcoming paper. Simulations for different 
bias current values [ISj show that the NES effect increases for smaller iq 
because the potential barrier disappears for a short time interval within 
the driving period T = ^tx jio and the potential is more flat [3]. The noise, 
therefore, has more chances to prevent the phase to move down and the 
switching process is delayed. This effect may be avoided, if the operating 
frequency does not exceed 0.2 Wc- Besides the SD and MST (see Fig. [5]) 
have their minima in a short range of values of uj |18j . Close location of 
minima of MST and its SD means that optimization of RSFQ circuit for 
fast operation will simultaneously lead to minimization of timing errors in 
the circuit. 



4. Dynamics of a FHN stochastic model 

4-1- Suppression of noise and noise- enhanced stability effect 

Case I. Let us fix the value of the noise intensity and analyze The analy- 
sis of the stochastic properties of neural systems is of particular importance 
since it plays an important role in signal transmission [19], [35]- [UJ. Bio- 
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logically realistic models of the nerve cells, such as widely-known Hodgkin- 
Huxley (HH) system [35] , are so complex that they provide little intuitive in- 
sight into the neuron dynamics that they simulate. The FitzHugh-Nagumo 
(FHN) model, however, which is one of the simplified modifications of HH, 
is more preferable for investigation [41j . Nevertheless many effects observed 
in neural cells are qualitatively contained in FHN model. Because of this 
the FHN model has got wide dissemination in the last few years. There 
has been a lot of papers where the influence of noise on the encoding sen- 
sitivity of a neuron in the framework of FHN model has been analyzed. A 
broad spectrum of noise-induced dynamical effects, which produce ordered 
periodicity in the output of the FHN system, has been discovered. Among 
these effects we cite the coherence resonance |36j and the stochastic reso- 
nance (SR) [37J. All these investigations deal with neuron dynamics with 
subthreshold signals, and with an enhancement of a weak signal through the 
noise. The presence of noise in the case of a strong periodic forcing, however, 
has a detrimental effect on the encoding process [Mj-Iin]- For suprathresh- 
old signals the noise always lowers the information transmission, and the 
SR effects disappear [38l [39] . However, as it was shown in recent papers 
of Stocks [40], this is only true for a single element threshold system. In 
neuronal arrays the noise can significantly enhance the information trans- 
mission when the signal is predominantly suprathreshold. It is the effect of 
suprathreshold stochastic resonance. 

Here we analyze the effect of noise in a single neuron subjected to a 
strong periodic forcing. We investigate therefore, the influence of noise on 
the appearance time of a first spike, or the mean response time, in the 
output of FHN model with periodical driving in suprathreshold regime. As 
it was mentioned before, the role of noise for a strong driving is negative. 
In this case noise suppresses the response of a neuron, that leads to delay 
of transmission of an external information. But we show that, this negative 
influence of noise on the spike generation can be significantly minimized. 

We analyze the dependencies of the mean response time (MRT) on both 
driving frequency and noise intensity. We find that, MRT plotted as a func- 
tion of the driving frequency shows a resonant activation-like phenomenon. 
The noise enhanced stability (NFS) effect is also observed here. It is shown 
that MRT can be increased due to the effect of fluctuations. We note that 
NFS has nothing to do with the typical SR, where the maximum of signal 
to noise ratio as a function of noise intensity is observed. There are many 
differences between these effects concerning the neuron dynamics. First of 
all the SR is related to the output of the neuron in stationary dynamical 
regime and concerns the signal-to-noise ratio, while the NFS describes the 
transient dynamical regime of a neuron and concerns the mean response 
time. In addition there is difference in the nature of the response: We 
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investigate the case of a strong driving, where the SR effects disappear. 

4-2. Deterministic dynamical regime 

The dynamic equations of the FitzHugh-Nagumo model with additive 
periodic forcing are 

X = X — — y + j4 sin(a;t) 

y = e{x + I), ^'^> 

where x is the voltage, y is the recovery variable, and e is a fixed small 
parameter (e = 0.05). In the absence of both external driving and noise, 
there is only one steady state of the system ([27|). that is xq = —I; yo = 
—1+1^/3. The choice of the constant I, therefore, fully specifies the location 
of equilibrium state in the phase space Here we consider I = 1.1. 

In our simulations we assume that the initial conditions for each real- 
ization are the same, that is the system is in its stable equilibrium point 
(the rest state) (xo,yo) at the initial time to- We would like to note, here, 
that even if we consider sinusoidal driving, we investigate the time of ap- 
pearance of the first spike only. We are interested in the capability of our 
system to detect an external input. This means to minimize the detection 
time and to get a neuron response that would be more robust to the noise 
action. After generation of the first spike, that is after approaching of the 
boundary x = 0, we break the realization off, and start a new one with the 
same initial conditions (xo,yo)- 

For our system the threshold value of the driving amplitude required for 
spike generation is A^^ ~ 0.05. In our simulations we choose A = 0.5. Thus, 
the frequency range where the signal of such amplitude is suprathreshold 
is: Q : uj G (0.013 -r- 1.9) [TD]. Inside this region the response time of a 
neuron has a minimum as a function of the driving frequency. System does 
not respond outside the range Here, a subthreshold oscillation occurs 
(see Fig. EKb)). In Fig. Wic) the time series of the output voltage x for a 
suprathreshold signal is shown. 

4-3. Suprathreshold stochastic regime 

Actually, there are many factors that make the environment noisy in 
the neuron dynamics. Among them we cite the fiuctuating opening and 
closure of the ion channels within the cell membrane, the noisy presynaptic 
currents, and others (see, for example, Ref. ^Mj)- We consider two different 
cases in which the noise is added to the first or the second equation of the 
system (j27|) : 
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Fig. 7. (a) The response time dependence versus the frequency of periodic driving 
for the deterministic case, A ~ 0.5. Examples of output trajectory for two values 
of driving frequency invoking two different kinds of oscillations: (b) subthreshold 
for uj = 0.01, and (c) suprathreshold for oj = 0.02. 



Case I The variable that corresponds to the membrane potential is sub- 
jected to fluctuations [371 SO]- In this case, the first equation of the sys- 
tem (j27p becomes the following stochastic differential equation 

x = x-x^/3 + Asm{ujt)-y + C{t); (28) 

Case II The recovery variable associated with the refractory properties 
of a neuron is noisy [36]. Here, the second equation of the system (j27p 
becomes 

y = e{x + I)+m, (29) 

In Eqs. (j28l) and (I29p . ^(t) is a Gaussian white noise with zero mean and 
correlation function {C{t)(,{t + t)) = D6{t). For numerical simulations we 
use the modified midpoint method and the noise generator routine reported 
in Ref [32]. 

The mean response time (MRT) of our neuronal system is obtained as 
the mean first passage time at the boundary x = 0: t =< T >= ^ J2f=i 
where Tj is the response time for i-th realization. To obtain smooth average 
for all the noise values investigated, we need different number of realizations 
in above considered cases. Namely, = 5000 in case /, and N = 15000 
in case II, specifically when the noise intensities are comparable with the 
value of the parameter e = 0.05. It is worth noting here that parameter 
characterizes the delay of the systems' response, and has a non-zero value 
even in the deterministic case, because of the non-instantaneous neuronal 
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response. In our investigation we consider a strong driving, so the noise 
increases the time of appearance of the first spike and leads to an additional 
delay of the signal detection. 

the MRT dependence on the driving frequency. In the small noise limit 
D — > 0, a typical behavior (see Fig. [8]) with perpendicular walls disposed 
at the frequencies corresponding to the boundaries of the region O was 
found. By increasing the noise intensity, these walls go down. We observe 
a resonant activation-like phenomenon: The MRT exhibits a minimum as a 
function of the driving frequency, which is almost independent of the noise 
intensity. 




0.0001 0.001 0.01 01 1 10 OOOOl OOOl OOl 01 1 10 



Fig. 8. (a) The mean response time dependence versus the frequency of pe- 
riodic driving for case /, for four values of the noise intensity, namely: D = 
0.005, 0.03, 0.07, 0.5. The right solid lines give the theoretical values of r for fixed 
bistable potential. Inset: frequency range where the noise enhanced stability ef- 
fect is observed, (b) The standard deviation of the response time dependence vs 
frequency of periodic driving for case /, for the same values of D. 

In the same figure (b) the standard deviation (SD) of the response time 
versus the frequency of the periodic driving shows a minimum. Therefore, 
the noise has minimal effect in the same range of driving frequencies for 
MRT and its SD. In a narrow frequency range (w G (0.6 1-3)) (see Fig. [8|), 
we found a nonmonotonic behavior of the MRT as a function of the noise 
intensity. Here the noise enhanced stability effect is observed (see the inset of 
Fig. E^) . Out of this range the MRT monotonically decreases with increasing 
noise intensity. For larger noise intensities the MRT dependence on driving 
frequency takes a constant-like behavior in the range of the investigated 
frequency values {uj G [10~^ 10]). Here, the dynamics of the system 
is mainly controlled by the noise, and the frequency of periodic driving 
does not affect significantly the neuron response dynamics. By numerical 
simulations of our system we find that, for large noise intensities, the MRT 



20 



SPAGNOLO'20.04.07 PRINTED ON OCTOBER 4, 2008 



coincides with that calculated by standard technique for a Brownian particle 
moving in a bistable fixed potential [44j 

r = 2/D r e^(^)/^ /"^ e-^^y^/^ dydx. (30) 

J Xq J oo 

The theoretical values reported in Fig. E^a) agree with the limiting values 
of T for Lo ^ and uj ^ oo. For e <C 1 in fact, x is a fast variable and 
y is a slow variable, so y ~ and this case can be recast as an escape 
problem from a one-dimensional double well in both limiting cases. In fact 
when (J ^ we have a fixed bistable potential, and for a; — > oo we have 
an average fluctuating potential, which coincides with the fixed one. This 
is weh visible in Fig. El^a) for D = 0.07. For D = 0.5 the MRT tends to be 
almost independent on the parameter iv. 




Fig. 9. The mean response time dependence versus the noise intensity for case /, 
for three different values of driving frequency: lu — 0.001, u — I and uj ^ 5. Solid 
line gives the theoretical values of r for fixed bistable potential. 

In Fig. [9] the MRT versus the noise intensity, for three values of the 
driving frequency, is shown. We see the nonmonotonic behavior for lo = 
1, which is a signature of the NES effect. It is interesting to note that 
even in this system, whose global dynamics cannot be described as the 
motion of a Brownian particle in a potential profile (because of the coupling 
between the two stochastic differential equations describing our system) 
a phase transition-like phenomenon, with respect to the driving frequency 
parameter w, occurs. In fact we have nonmonotonic and monotonic behavior 
depending on the value of lo. We expect similar behavior, if we fix the 
driving frequency and we change the value of the amplitude A of the driving 
force [3 IT]. 
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Case II. In this case, for noise intensity values greater than e = 0.05, 
the recover variable can be approximated by a Wiener process (y ~ ^(^))- 
This process acts now as a noise source in the same double well potential 
according the following stochastic differential equation 

± = x-x^/2> + A sm{ojt) + W(t) , (31) 

where W{t) is the Wiener process with the usual statistical properties: 
{W(t)) = 0, and {W^it)) = t. 




0.0001 OOOl 0.01 0.1 1 10 OOOOl 0.001 0.01 0.1 1 10 



Fig. 10. (a) The mean response time dependence vs the frequency of the pe- 
riodic driving for case //, for four values of the noise intensity, namely: D — 
0.001,0.005,0.07,0.5. The curve with diamonds gives the values of r for fixed 
bistable potential, when the noise source is a Wiener process, (b) The standard 
deviation of the response time dependence vs frequency of periodic driving for case 
//. 

In Fig. [TOlfa) the curve with diamonds shows the results of this approxima- 
tion for D = 0.5. We found again a resonant activation- like phenomenon 
(see Fig. [TOj) . which is independent of the noise intensity, as in case /, until 
D reaches the value of parameter e. The minimum tends to disappear for 
greater noise intensities. Here a certain frequency range (u G (0.019-^1.6)), 
larger than in previous case, exists where an increasing noise intensity leads 
to a monotonic growth of the MRT. Out of this range the MRT monoton- 
ically decreases with increasing noise intensity, as in case /. In Fig. fTOTb) 
the standard deviation of the response time versus the driving frequency is 
shown. Also in this case II, the SD shows a minimum in the same frequency 
range of that found for MRT. We have found, therefore, a parameter region 
where there is minimization of the MRT and its SD, that is "suppression of 
noise" . 

We also observe that the saturation level reached in each case is different. 
Particularly in case // it is greater than in case /, because the MRT is 
calculated with respect to the membrane voltage x and with different noise 
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sources. Therefore, in phase space the variable x reaches, in case /, in a 
minor average time the boundary x = 0, according to Eq. (j28p . While in 
case // the variation of x depends on the dynamics of the y coordinate and 
takes much more time to reach the same boundary. 



5. A stochastic model for cancer growth dynamics 

In this last section we shortly summarize some of the main results ob- 
tained with a stochastic model for cancer growth dynamics (see Ref. |21] for 
more details). Most of tumoral cells bear antigens which are recognized as 
strange by the immune system. A response against these antigens may be 
mediated either by immune cells such as T-lymphocytes or other cells like 
macrophages. The process of damage to tumor proceeds via infiltration of 
the latter by the specialized cells, which subsequently develop a cytotoxic 
activity against the cancer cell-population. The series of cytotoxic reactions 
between the cytotoxic cells and the tumor tissue have been documented to 
be well approximated by a saturating, enzymatic-like process whose time 
evolution equations are similar to the standard Michaelis-Menten kinet- 
ics [m |46]. The T- helper lymphocytes and macrophages, can secrete cy- 
tokines in response to stimuli. The functions that cytokines induce can both 
"turn on" and "turn off" particular immune responses |47[ I48j . This " on- 
off" modulating regulatory role of the cytokines is here modelled through a 
dichotomous random variation of the parameter P, which is responsibile for 
regulatory inhibition of the population growth, by taking into account the 
natural random fluctuations always present in biological complex systems. 

The dynamical equation of this biological system is 

x = -±l + ^{t), (32) 

ax 

where ^(i) is a Gaussian process with (^(t)) = 0, {i{t)^{t')) = D6(t — t'), 
and 



U^ix) = + + (/3, ± A)(x - ln(x + 1)), (33) 

is the stochastic double well Michaelis-Menten potential with one the min- 
ima at X = 0. Here x{t) is the concentration of the cancer cells. The process 
P = (/3o=t A) can change the relative stability of the metastable state of the 
potential profile [l6] . We note that the RA and NES phenomena act counter 
to each other in the cancer growth dynamics: the NES effect increases in an 
unavoidable way the average lifetime of the metastable state (associated to 
a fixed-size tumor state), while the RA phenomenon minimizes this lifetime. 
Therefore it is crucial to find the optimal range of parameters in which the 
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positive role of resonant activation phenomenon, with respect to the can- 
cer extinction, prevails over the negative role of NES, which enhances the 
stability of the tumoral state. These are just the main results of the pa- 
per [21], that is both NES and RA phenomena are revealed in a biological 
system with a metastable state, with a co-occurrence region of these effects. 
In this coexistence region the NES effect, which enhances the stability of 
the tumoral state, becomes strongly reduced by the RA mechanism, which 
enhances the cancer extinction. In other words, an asymptotic regression to 
the zero tumor size may be induced by controlling the modulating stochastic 
activity of the cytokines on the immune system. 

6. Conclusions 

Natural systems are open to the environment. Consequently, in general, 
stationary states are not equilibrium states, but are strongly influenced by 
dynamics, which adds further challenge to the microscopic understanding 
of metastability. The investigation of two noise-induced effects in far from 
equilibrium systems, namely the RA and NES phenomena, has revealed 
interesting peculiarities of the dynamics of these systems. Specifically the 
knowledge of the parameter regions where the RA and NES can be revealed 
allows: 

• to optimize and to suppress timing errors in practical RSFQ devices, 
and therefore to significantly increase working frequencies of RSFQ 
circuits; 

• to optimize the operating range of a neuron, and therefore to realize 
high rate signal transmission with the suppression of noise; 

• to maximize or minimize the extinction time in cancer growth popu- 
lation dynamics. 
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